Development of Harp-DAAL Interface
نویسندگان
چکیده
Nowadays, many data analytics and machine learning problems contain millions or billions of training data and parameter data, it is obvious that the Distributed Processing mode is the only choice for many applications. Within DAAL's framework, the communication layer of the Distributed Processing mode is left to the users, which could be Hadoop, Spark, MPI, or any of the user-defined middleware. The goal of our project is thus to fit Harp, a plug-in into Hadoop ecosystem, into the Distributed Processing mode of DAAL. Compared to contemporary communication libraries, Harp has the advantages as follows:
منابع مشابه
Harp-DAAL: A High Performance Data-Intensive Machine Learning Framework
Nowadays, many data analytics and machine learning problems contain millions or billions of training data and parameter data, it is obvious that the Distributed Processing mode is the only choice for many applications. Within DAAL's framework, the communication layer of the Distributed Processing mode is left to the users, which could be Hadoop, Spark, MPI, or any of the user-defined middleware...
متن کاملS-HARP: A Parallel Dynamic Spectral Partitioner
Computational science problems with adaptive meshes involve dynamic load balancing when implemented on parallel machines. This dynamic load balancing requires fast partitioning of computational meshes at run time. We present in this report a fast parallel dynamic partitioner, called S-HARP. The underlying principles of S-HARP are the fast feature of inertial partitioning and the quality feature...
متن کاملDevelopment of Web-based Environment for Atmospheric Dispersion Modeling
The paper presents a new web interface to the atmospheric dispersion model HARP (HAzardous Radioactivity Propagation) which is a segmented Gaussian plume model certified for the emergency management use in the Czech Republic. Up to now, the model was available only as a desktop application. The new web-based user interface should bring the basic functionality of the model to the web environment...
متن کاملDevelopment of Ultrahigh-sensitivity HARP Pickup Tube and Its Applications
In 1985, the author found for the first time that an experimental pickup tube with an amorphous selenium photoconductive target exhibits high sensitivity with excellent picture quality because of a continuous and stable avalanche multiplication phenomenon. We named the pickup tube with an amorphous photoconductive target operating in the avalanche-mode “HARP”: High-gain Avalanche Rushing amorph...
متن کاملIP and ARP over HIPPI-6400 (GSN)
IP and ARP over HIPPI-6400 (GSN) Status of this Memo This document specifies an Internet standards track protocol for the Internet community, and requests discussion and suggestions for improvements. Please refer to the current edition of the "Internet Official Protocol Standards" (STD 1) for the standardization state and status of this protocol. Distribution of this memo is unlimited. Abstract...
متن کامل